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Joint maximum likelihood sequence estimator with dynamic channel description 



(57) A cellular communication signal receiver (10) 
receives a desired signal, in the presence o1 at least one 
co-channel interference signal. The receiver comprises 
a channel estimator (1 2) configured to receive a plurality 
of training signal samples to estimate the finite impulse 
response to the desired signal and the co-channel inter- 
ference signal. The finite impulse response estimates 
having a predetermined number of channel taps define 
the length of the desired channel and the length of co- 
channel interference channel. A Viterbi decoder (20) is 
coupled to the channel estimator, and configured to re- 



ceive the desired and co-channel interference signals. 
The channel estimator generates channel tap esti- 
mates. 

A power calculator (14) is coupled to the channel 
estimator and configured to estimate the power of the 
estimated channel taps. A joint channel trimmer (18) is 
coupled to the power calculator and configured to main- 
tain ajoint channel length, such that the desired signal 
channel length plus the co-channel interference channel 
length have a fixed size that defines the number of 
states the Vrterbi decoder allocates to the desired signal 
and the co-channel interference signal. 
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Description 

Field Of The Invention 



[0001] This invention relates to a cellular communication system and more specifically to « ^ *?LJ 

employed to receive digitally modulated signals in the presence of another modulated channel .ntertenng (CCI) 

signal. 

Background Of The Invention 

10002] m mobile radio communications, the radio spectrum is ascarce resource. As a result <»^^f^ 
munitions system are based on the cellular principle. Basically, a geographical are* wrthm 
Tavaiteble is divided into several cells. Schematically, each cell is represented as a hexagon, '"P^« h « 
eachC a s a shape that is dependent on, among other things, the topography of the terrain 
Sch cell includes a base station, which may be located approximately at its center. Each base Mhon is conftnd 
totls" recerve signals wrthin approximately the area ^^.^^^^^ 
each base station may extend beyond each cell area. Therefore, it is desired that a different set of fluencies oe 

subscribers by using a wireless terminal (e.g., a cellular telephone, a wireless local loop tenrnna h some co »w 
eohones oneway and two-way pagers. PCS terminals and personal digital assistants). Each w.reless terminal kxated 
wCa ceTseTs I !and reJJes'signals from the corresponding base station located in that ce.l, over a commune 
cations channel within a predetermined frequency range. 

[0003] Since adjacent cells employ different sets of frequencies, the distance between two celU MM us > the same 
requency se, ma be an important design consideration. This distance is called the 
to increase the total number of channels available per unit area, It is desired to 

reducing the size of the cells, it is possible to reuse the same frequency Mr mK ^7^^^^ 
be able to use the system, because of the increase of avaifcble frequency sets within a ^^^^cl 
- depending upon the size of each cell, the transmission power of the base stat,ons and the mob.le units, severe co- 
channel interference between the cells that use the same frequency range may occur. , 
[0004] The maximum likelihood sequential estimation (WILSE) equalizer can equalize the channel 
achieve optimal performance. The MLSE equalizer is particularly useful in a radio channel wrth a long spread such a 
fhe one that employs a standard specification known as Gtobal System for Mobile ^^T^^J^Z 
approach to reduce co-channel interference is to employ antenna arrays. Because of ^ ( ^^^ a J^?. 
. between the desired signal and the co-channe, interference signals, antenna ojjj-j- ««J« . 

ss ence signals through beam forming. However, these approaches require very complicated signal processing 

iSTuslttrfneed to reduce the complex!* of such systems, to make them commerce teasfo.e, and to 
reduce the effects of co-channel interference signals considerably. 

40 Summary Of The Invention 

[0006] In accordance wrth one embodiment of the invention, a communication signal receiver ^^ a " n ^ 
Stor that is configured to receive a plura.rty of training signal samples to "*^2!ZE75Ei 
both desired signals and co-channel interference signals. These finite .mpuise response ^^^^ 

• m^numbero.channe.tapsc^ 

tiveiy. The channel tap estimates are then provided to a Vherbi decoder. The channel tap est 
toapowercalcufctortha, estimates the power of eachofthe estimated channeltaps. The "^^^"^J 
are then provided to a joint channel trimmer. The joint channel trimmer maintajns a ^^"J^tSI! £ 
desired signal channel length plus the co<hannel interference channel length have a ' TJS the 

bo weakest tips from both edges of the channel taps. The joint channel length « dynamea ly a J"***^ Jj 
desired channel taps and channel interference channel taps. The trimmed channe \ saes are torn . pmd« tothe 
Vfferbi decoder, which decodes the reserved signals in accordance with the channel estimates and the calculated 
channel sizes. 

55 Brief Description Of The Drawings 

[0007] Thesubjectnnatterregardedasthe^^ 

portion of the specification. The invention, however, both as to organizabon and method ol operation, together wrth 
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features, objects, and advantages thereof may best be understood by reference to the following detailed description 
when read with the accompanying drawings in which: . • muontinn 

rooOS] Fig. 1 illustrates a block diagram of a receiver in accordance with one embedment ofthe prase rtn^ta. 
pooq Fig. 2 illustrates a burst signal received by the receiver in accordance with one embod.men, of the present 

5 [wTof "Fig. 3 is a flow chart illustrating the operation process of a system in accordance with one embodiment of the 

£01 1]" 1 'STi illustrates a trellis diagram employed by a Werbi decoder in accordance with one embodiment of the 
invention. 

JO 

Detailed Description of The Drawings 

[0012] Fig. 1 is a block diagram of a communications receiver in accordance with one embo dimen, o"he hv e ntbn 
although the invention is not limited in scope in that respect. Receiver 10 includes a ,o.nt channel est mato M2 wh.ch 
u fscoX^ 

version ,of signalsthat have beenreceived by an antenna array 22 and down converted to baseband by a down converter 

P013) Antennaarray22receivesbothdesiredsignalswiminacallandco<hanneUnterterence 

outside a cell. Joint channel estimator 1 2 is configured to jointly estimate the fmrte .mpulse responses of the channels 

20 tor both the desired signal and the co-channel interference signal. ^i^h™ a > 
00 4 Several approaches are being employed with respect to signaBng standards for <£'^£££ 
worldwide. One such standard is Europe's global system for mobile communions (GSM), d escnbe ^ ^T J/GSM 
Series 03 Air Interference Specification, GSM PN Paris, herein incorporated by reference. One aspect of the standard 
involves the transmission of signals in the form of signal bursts. • e „. h ae mav be emDloved 

25 rooi 51 Fig 2 illustrates a signal burst also known as a transmission burst or a s.gnal frame, such as may ^ employed 
in a tone division multiple access (TDM A) wireless communication system, although the '"J 6 " 1 ' 0 " 'j^^^^unrt 
to a signal burst hav,ng this particular form or format. In the present context, ^ tenns s,gnal ^"^"^^S 
or signal frame may be used interchangeabfy. The signal or transm.ss.on burst .Unrated .n F*2 has ' P^™£ 
number of digital symbols or bits. In this particular embodiment, each burst .ncludes, .n succession, a ser.es ^of sue 

S o cesste predetermined starthg bits 27, a predetermined number of hformaton bits 29 a ser.es o ££££ 
.raining bits 31, a second predetermined number of information bits 33, and a eer.es of 
ending bits 35. In GSM systems, for example, there are three starting and three ending M.,87 b ts 
the signal burst comprising binary digital signals to be transmitted, and 26 tra,n.ng brts re,er ^ h f t ^" da ^^; 
• tor a total of 14B btts per signal buret. The training bits are known at both the recemng and m ^"ansm^g end o 

35 the communications system. The starting and ending bits are likewise known and are typically zeros. It will be ap 
preciated that other numbers and distribution of bits are possible depending on the «P^a«n. 
[00161 The GSM telecommunication standard requires a form of signal modulat.on in the baseb ^<""" Gaus 
LSinimum Phase Sh» Keying (GMSK). .1 is noted that although OMSK is not , . .ear ^^^^ 
be approximated as such. GMSK is described in more detail in Dinnal Phase Mod "'*.on byj-B i ff^J^ 

40 and C E Sundburg. 1936, available from Plenum, although, of course the .nvent.on is not hmrted m scope to GMSK 



of the channel over which the transmission occurred. This channel estimate is the ^ite jmpu^ ' ™ * e °< 
wireless channel through whfch the bursts are being transmuted from transmitter 
4B oelltoa receiver station, such as receiver 10. The received signal is distorted due tono.se and "^^J^ 
(ISI) associated with transmission via the wireless channel. By minimizing the norm of the «™ 
he desired channel and co-channel interference channels is obta^ed. Each term ,n the ,mpu se ^ ■ 
quantity and is referred to in this context as a tap weight or channel tap. Each tap we.ght represents the effects 
channel distortion on the transmitted signal, as will be explained in more deta.l below inlerter ence sional 

[0018] In ordertoobtainachannel estimate corresponding to both des.red s.gnalsand oxhannel interference s.gnal, 
a channel model is employed as will be explained in more detail hereinafter. 

[OoS; ^sum-g a UnJr modulation scheme, the desired signal and the channel interference s.gnal can be ex- 



so [0018] 



[0019] 

pressed respectively, as 
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and 



20 



* 

where a m o,are respectively, the pulse-shaping functions of the desired signal and co-channel interference signal. [s£ 
Is- J are respectively, the data sequences ot the desired signal and cc-channel interference signal, and Tts the period 
of 'each symbol or signal sample. Therefore, the signal received at the/* antenna of antennaarray 22 can be written as 



so 



55 



Xj{t)=lc s j{t-z) s(t)&i +Je f (!-T) ~Si(z)ck + n{t) 



(3) 



ib where Csf (f)and c,(0 are respectively the physical channel impulse response of the /'antenna of the desired signal 
and co-cnannel interference signal; and n(t) is the additive noise. Substituting s(t) and s/tftrom equations (1) and (2). 
equation (3) can be written as 



After sampling Xj (t), equation (4) can be written in a matrix form as 

where the subscripts denote the size of the matrices; m is the number of antennas in antenna array 22; / is made long 
enough to cover all the non-zero terms of h t>/ and /w.ntime samples are under ^nsideration in equation (5), the 
» row of Hs is [fi-(to), h s Jto-n..., h sJ (to - ("M^/the f row of H/is [hjto), ^/to-TJ ... yto- (h WJ***** 1 . 
matrix with [s^s^as its first'column and s k+1 ...s k ^) as its first row, S, is also a Toeplrtz matnx with [s ijp 
Sj, w ...s i>w+ ,] T as its first column and [s iik , , s,- M ...s t ^,) as its first row. 
[0020] Equation (5) can be written as 

X=[Hs Hi\[g) + N < 6 ) 

wherein X refers to signal samples received by the receiver, and N is the additive noise received by the receiver. 
Assuming that noise N is a Gaussian white noise the least square solution can be written as 

40 

[HsHf\=[ S s f W 

where (.)* denotes pseudo-inverse, which is defined as A* = (A" A)* 1 A* 
45 [0021] II is noted that equation (7) provides the finite impulse response of the desired signal channel, H s , and one 
cc-channel interference channel H, However, there may be instances that more than one neighboring cell provides a 
co-channel interference signal. It is appreciated that equations (1 ) through (7) above may be expanded to incorporate 
additional co-channel interference signals. In that event, equation (7) may be expanded as 



[Hs H 0 ...MJ. *[*}■ < 7a > 



wherein H. corresponds to finite impulse response of the co-channel interference signal provided via the rf" channel 
from cell np roximate to the cell wherein the desired signal is transmitted and Sn is the training sequence provided by 
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S^Cl^lel estimator 12 b configured to derive channe, estimates based on training bits and actual 

received signal as shown in equations (7) or (7a). H MiPO H einnai 

[0023] The channel tap estimates are then provided to a Vrterbi decoder 20 to demodulate ^h the des^d agna 
s and the co-channel interference signal. The channel tap estimates are also provded to an .nput port rt a tap .power 
caiculator 14. The output port of tap power caiculator 14 is coupled to an input port of a tap power 
which is configured tomultiply the channel taps corresponding to the co«hanne^ 

Thereafter thl I output port of tap power weighting unrtlBis coupled toajo.nl ^channel ^.^^^Z^ 
• to truncate a plurality o. channel taps corresponding to the desired signal and the ccxhannel ""^J*^ 
io that the total number ot taps representing the channel estimates tor both signals reman a constant, as will be explained 

in more detail hereinafter. , . A ,„ rf , i ^^ or on iwhieh is 

[0024] The output port of joint channel trimmer 16 is coupled to an .nput port of jont Viterbi decoder 20. which is 
-configured to have a fixed number of states as set forth by the number of taps specified by channel trimmer IB. 
ZJi Tap power calculator 14 is configured to cafculate the strength o, each finite impulse response top for both 
« he desiredYgnal and the co-channe, interference signal. The strengths of the finite ^nputee 

desired signal channel is referred to as Ps and the finite impulse response taps for the co-channel .nterterence signal 
channel is referred to as PL Thus power signal Ps and power signal Pi can be written as 

2o P 5 =) iim (H s Ocor ? (H,)),P=1 lxn) (H,Ocon,(H,)) (8) 

wherein 1 hm is a column vector with each element being'one, conj(.) denotes the complex conjugate operation and © 

denotes the Hadamard product. „„K~<i m = n t «r the in. 

[0026] Fig. 3 is a flow chart illustrating the operation of recerver 10 in accordance wrth one embodiment of ttie in 
lention. although the invention is not.imrted in scope in that respect. During operation at step "Ojont channe, 
estimator 12 for each received burst obtains a joint channel estimation for both desired signals and 
lerence signals received by receiver 10. Joint channel estimator 12 empioys the training bits in each , burst tc ^obtain 
the joint channel estimation for the desired signals and co«hanne. estimation signals as de scrib^ at ove Jo th-s end 
joint channel estimator 12 provides a plurality o1 channel taps corresponding to the desired and channel .nterterence 

[oST At step 112tap power calculator 14 ca.cu.ates the power Ps and P/of the channe. taps obtained * 
• n accordance wrth equation (8) as described above. Thereafter, at step 114 tap power weighing unrt 1£ ^umpl.es a 
w^ghingtactorwwithchanneltappowervalues^^^^ 

the effect o, co-channe. .nterterence signal This follows, because the data brts embedde ^^^SSZS 
« ence signal are of no interest to receiver 1 0. Preferably, the weighing factor w .s chosen to be close but less ; that one 
?0028] At step 116, joint channe. trimmer 16 truncates the combined number of channe. taps corresponding ^othe 
desired and co-channe. interference signal to a fixed specifiable number, l c . It is noted a large value ^ or / mean 
relatively lower channel estimation error in the Vrterbi decoder and relatively higher complexrty. For example every unrt 
increase to l c leads to doubling the complexity of the Vrterbi decoder employed .n rece.ver 10. 
<o [0029] Thus, joint channel trimmer 1B truncates the end portions of channel taps corresponding to both desired and 
co-channel interference channels by finding the weakest tap power based on 



3D 



(9) 



where / « U» are respectively, the first and the last taps of the finite impulse response channel taps 

of the desired and co-channel interference signals wrth t, » 2 U. and >lm * kjasr Th "S. *™ 
compares the power corresponding to the first and last channel taps and el.minates the P"J 
For example, if the power of the first channel tap P. (W * the weakest, it gets ^^j^f.^"^ 

50 Similarly if the power of the last channel tap „(/,, ^ is the weakest tap, it gets truncated by the channel tnmmer Step 
llT is repeated until channe, trimmer 1 8 at step 118 determines that combined number of the ^g channel 
i e ( / L- 1 , J - ( /-/»*- UJ = t wherein l c is a fixed number. It is noted that the term ( WW corresponds to 
the' !^^J&*£U tops, /, corresponding to the desired signal and ( l iJUst - W) corresponds to the 
remaining number of channel taps, /, corresponding to the co-channel interference channel. 

* [0030] It is noted that for those bursts with a high carrier to interference ratio (CIR), the system employs all thetaps 
o describe the desired signal channel to reach the tower bound of a bit error rate. Converse*, tor those bursts wrth a 
lower carrier to interference ratio, the system employs more taps for the co-channel .nterterence channel so as to 
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70 



IS 



mitiaate the impact ot co-channel interference. \ 
fooll] OnceLchanneltapsconespondingtodes^^ 

decoder 20 employs the remaining channel taps, indicated by WW W and ^ /.and / ( to decode the s.gnals 

X that are provided from antenna array 22. . . . ,„ 

r0032] Thus, at step 120, Viterbi decoder 20 demodulates both the desired data sequences and co-channel inter- 
ference data sequences. Vrterbi decoder 20 is a maximum likelihood decoder that provides forward error correct^ 
The Viterbi decoder works back through a sequence ot possible bit sequences at each symbol 'n^n.tod^erm.e 
which bit sequences are more likely to have been transmitted. The possible transrtions from a s.gnal statu ; at one 
symbol instant, or.state, to a signal status at a subsequent, symbol instant or state ,s bnrted Each 
from one state to a next state may be il.ustrated graphical and is referred as a branch ,n this conte JjAjJJJJ ° 
interconnected branches is referred to as a path in this context. Each state may transrt.cn only »-*^"*"2 
next states upon receipt of the next bit (or set of bits) in the bit stream. Potential paths rema.n while other potent^ 
paths are eiiminated during the decoding process. Thus by eliminating those paths that are not perm.ss.ble, compu- 
tational efficiency may be achieved in determining the most likely paths to have been transmitted. 
[0033] In accordance with one embodiment of the invention, because channel taps corresponding <°J^«»B" 
and co-channel interference signal are truncated on a burst-to-burst basis, the number of states in the ^.decode 
that correspond to the desired s.gnal and the co-channel interference signal may ^J™™^^"'!™ 
example, in accordance with one embodiment of the invention, the total number of channel taps l e may be 5, as Hlus- 

20 loS]" Thus'tor an exempfcry data buret, after channel truncation, channel trimmer 1B allocates A""*"^ 
to the desired channel and two channel taps to channel interference channel. As illustrated n F.g^ 4, Vrterb, decoder 
20 operates with an B-state trellis 210 that correspond to the 3-tap channel memory corres P° nd 79; h V^™ 
channel, and with a 4-state trellis 212 that correspond to the 2-tap channel memory corresponding to jhe cc-ch nnel 
interference channel. Thus, as illustrated in Fig. 4, each branch in B-state trellis 210 ,s expe inded to4-att 

2S The total number of states is the product of the numbers of the desired signal states and the channel n "?S2S2 
states. Thus, for the example illustrated in Fig. 4. the total number of states .s 32. Each state has tour .nput branches 

[O^A^ 

, the received signal x . Viterbi decoder 20 then employs the Fobenius norm square of the dffl erence 
so constructed received signal and the actual received signal. || X - X |P F , as the incremental metrics for eac i branch 
wherein the operator IMl F , denotes the Fobenius norm. By minimizing the node metre tn the Vrterb, algorrthm, Vrterb, 
decoder 20. searches for the most likely data sequence in the trellis. 

[0036] Once the data for one burst is estimated, step 110 is repeated again for following bursts. 
003^ Thus.inaccordancewittthepresentinvention^^^ 

35 bw bit error rates. Furthermore, features such as weighing the channel power taps corresponding to 

f erence signals, and truncating the total number of channel taps allow for a relatively simple and mexpensrve arrange- 
rs While only certain features of the invention have been illustrated and described herein, many mdtattm. 
substnutions, changes or equivalents will now occur to those skilled in the art. It is therefore, to be the 

.0 appendedclaimsareintendedtocoverallsuchm^ 



Claims 

4S 1 



A cellular communication signal receiver for receiving a desired signal in the preeence of at least one co«hannel 
interference signal, said receiver comprises: 

a channel estimator configured to receive a plurality of training signal samples to estimate the finite impulse 
response to saiddesired signal and said co-channel interference signal, said finrteimpulse response estates 
so having a predetermined number of channel taps defining the length of the desired channel and the length of 

co-channel interference channel; „^h=»nnoi 
a Vrterbi decoder coupled to said channel estimator and configured to recede sa.d desired and co-channel 
interference signals, and said channel tap estimates generated by said channel estimator; 
a power calculator coupled to said channel estimator and configured to estimate the power of said est.nr.ated 

' flannel trimmer coupled to said power calculator and configured to maintain a joint channel tatfh. 
such that the desired eignal channel length plus the cochannel interference channel length have a toed size 
that defines the number of states said Vrterbi decoder allocates to said desired s.gnal and said cochannel 
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20 



interference signal. 



2 The receiver in accordance with claim 1 . wherein signals received by said recover are formatted as signal bursts, 
and said channel estimator estimates said channels on a bursl-by-burst basis. 

5 3. The receiver in accordance with claim 2, wherein said joint channel trimmer is coupled to said Vrterbi decoder. 

4 The receiver in accordance with claim 3, further comprising a power weighing unit coupled to said tap power 
ScuEo! ^figured to multiply said estimated channel taps corresponding to c*channel nterterence s.gnal by 
70 a weighing factor. 

5. The receiver in accordance with claim 4, wherein said weighing tactor is less than one and said power weighing 
unit is coupled to said joint channel trimmer. 

« 6 The receiver in accordance with claim 5, wherein said channel trimmer dynamically allocates said fixed channel 
length between the desired channel taps and cr>channel interference channel taps. 

7. A method for receiving a desired signal in the presence of at least one cochannel interference signal, said method 
comprising the steps ot: 



(a) receiving a plurality ol training signal samples ; ^ rrae ™„Hinn tr> 

b in response to said signal samples estimating the finite impulse response of channels , to 

said desired signal and said channel interference signal, by generating a predetermined number of channel 
taps defining the length of the desired channel and the length of channel interference channel, 

zs Ic) calculating the power corresponding to each one of said estimated channel taps, 

id) trimming said channel taps so as to maintain a joint channel length, such that the des,red signal channel 

length plus the co-channel interference channel length have a fixed size, and 

(e) decoding signals received by said receiver by employing said trimmed channel taps. 

'» . 6. The method in accordance with claim 7. further comprising the step of repeating steps (a) through (e) on a burst 
by burst basis. 

9. The method in accordance with claim receiver in accordance with claim 8, wherein said decoding step comprises 
the step of Viterbi decoding said received signals. 

* 10. The. method in accordance with claim 9, further comprising- the step of multiplying said estimated channel taps 
corresponding to co-channel interference signal by a weighing factor. 

11. The method in accordance with claim 10 comprising the step of setting sad weighing tactor to a number less than 
40 one. 

12. The method in accordance with daim 10, wherein said trimm^g step turther comprises the tf ep hS '^mtolly 
allocating said fixed joint channel length between the desired channel taps and channel mterference channel 
taps, on a burst-by -burst basis. 

45 
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(54) Joint maximum likelihood sequence estimator with dynamic channel description 



(57) A cellular communication signal receiver (10) 
receives a desired signal in the presence of at least one 
co-channel interference signal. The receiver comprises 
a channel estimator (12) configured to receive a plurality 
of training signal samples to estimate the finite impulse 
response to the desired signal and the co-channel inter- 
ference signal. The finite impulse response estimates 
having a predetermined number of channel taps define 
the length of the desired channel and the length of co- 
channel interference channel. A Viterbi decoder (20) is 
coupled to the channel estimator, and configured to re- 



ceive the desired and co-channel interference signals. 
The channel estimator generates channel tap esti- 
mates. 

A power calculator (14) is coupled to the channel 
estimator and configured to estimate the power of the 
estimated channel taps. A joint channel trimmer (18) is 
coupled to the power calculator and configured to main- 
tain ajoint channel length, such that the desired signal 
channel length plus the co-channel interference channel 
length have a fixed size that defines the number of 
states the Viterbi decoder allocates to the desired signal 
and the co-channel interference signal. 
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